arXiv:math/0503361vl [math.CA] 17 Mar 2005 


Convergence Criteria for a 
Hopfield-type Neural Network 

Raveen Goundar* 
and 

Jito Vanualailai 

Department of Mathematics and Computing Science, 
University of the South Pacific, Suva, Fiji. 


2000 Mathematics Subject Classification: 34D20, 92B20. 


Abstract 

Motivated by recent applications of the Lyapunov’s method in arti¬ 
ficial neural networks, which could be considered as dynamical systems 
for which the convergence of the system trajectories to equilibrium 
states is a necessity. We re-look at a well-known Krasovskii’s stabil¬ 
ity criterion pertaining to a non linear autonomous system. Instead, 
we consider the components of the same autonomous system with the 
help of the elements of Jacobian matrix J(x), thus proposing much 
simpler convergence criteria via the method of Lyapunov. We then 
apply our results to artificial neural networks and discuss our results 
with respect to recent ones in the field. 
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1 Introduction 


The Direct Method of Lyapunov, which utilizes energy-like functions called 
Lyapunov functions, is now a well-entrenched technique in the qualitative 
analysis of mathematical systems governed by differential equations. A flurry 
of activities by mathematicians, particularly within the period of early 1940s 
and the late 1960s, extended the work of Lyapunov to produce results that 
are now indispensable in many applications. (A good modern review of the 
Lyapunov method and its many applications is by Sastry [T].) This paper is 
motivated to a large extent by modern applications of the Lyapunov method, 
especially in the field of artificial neural networks. 

We start by considering the autonomous system of the form 

x\t) = g{x) ,x{tQ) = Xq. (1) 

Throughout the paper, guided by a well-known result of Krasovskii, we will 
strive to portray a simple and flexible method of proposing a stability crite¬ 
rion for system (^. We conclude by considering an application in artihcial 
neural networks. 

Throughout the article, we suppose that, in system ((T)), g G C[R^ , R^], 
and is smooth enough to guarantee existence, uniqueness and continuous de¬ 
pendence of solutions x{t) = x{t; Xq), with x = [xi, ... , XnY . The following 
definition and theorems of Lyapunov will be used in this article. (We will 
use those in Glendenning |2]). 

Definition 1. Suppose that the origin, x = 0, is an equilibrium point for 
system m- Let D be an open neighborhood of 0 and V : D ^ R be a 
continuously differentiable function. Then we can define the derivative of V 
along trajectories by differentiating V with respect to time using the chain 
rule, so 

V\x) = = x' ■ VV{x) = g{x) ■ VV{x) = ^ , 

i=l * 

where the subscripts denote the components of g and x. Then V is a Lya¬ 
punov function on D iff 

(i) V is continuously differentiable on D ; 
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(ii) y(0) = 0 and V{x) > 0 for all x e D \ {0} ; 

(iii) V'{x) < 0 for all x E D. 


Theorem 1 (Lyapunov’s Stability Theorem). Let x = 0 be an equilib¬ 
rium point for system (Op and D C be a domain containing x = 0. Let 
V{x) be a Lyapunov function on an open neighborhood of D, then x = 0 is 
stable. 

Theorem 2 (Lyapunov’s Asymptotic Stability Theorem). Let x = 0 

be an equilibrium point for system m and D C i?"' be a domain containing 
X = 0. Let V{x) be a Lyapunov function on an open neighborhood of D. If 
V'(0) = 0 and V'{x) < 0 for all x E D \ {0}, then x = 0 is asymptotically 
stable. 

Theorem 3 (Lyapunov’s Theorem of Global Asymptotic Stability). 

Let X = 0 be a equilibrium point for system m and let V(x) be a Lyapunov 
function for all x E RL. If x = 0 is asymptotically stable and V{x) is 
radially unbounded, then x = 0 is globally asymptotically stable. 

We carry the assumption that gf(0) = 0 so that 0 is the zero solution of 

o. 


2 Convergence Criteria 


In 1954, Krasovski! j3] established an asymptotic stability criterion that 
avoided the linearization principle, and in the process established a method 
of estimating the extent of asymptotic stability region for a nonlinear sys¬ 
tems. He assumed that g E C'[R^, i?""] and fl'(O) = 0. Then system (HP can 
be written as 


x'{t) = / J{sx)xds 
Jo 


where J is the Jacobian matrix 


J{x) = 


dgjx) 

dx 


The following result by Krasovski! is a fundamental one in control theory. 
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Theorem 4 (Krasovskii |3j). Let g E C'[R^, BL] and g(0) = 0. If there 
exists a constant positive definite symmetric matrix P such that 

x'^[PJ{x) + j'^{x)P]x 

is a negative definite function, then the zero solution of system m is globally 
asymptotically stable. 

For our purpose, we need a criterion that explicitly uses each component 
of system o. Thus, using the elements of Jacobian matrix; Jij{x), we define 

D{x) = [dij{x)]^^^ (2) 


where 


dij{x) = / Jij{sx)ds = 


dgfisx] 
) d{sxj) 


ds , 


such that system m can be rewritten as 

x'(t) = D{x)x . (3) 

A decoupled form for the i-th component of system is 

n 

xfit) = dii{x)xi + ^ dij{x)xj . (4) 

Remark 1. Note that in 0, the term dij{x)xj, for i,j = 1,..., n, is con¬ 
tinuously differentiable with respect to a; G for the simple reason that 
D{x)x = g{x) and g E C"[R”,R"^]. 

The following result of ours, guarantees the convergence criteria for au¬ 
tonomous system O- 

Theorem 5. Let g E C'[R^, RL] and g{0) = 0. Let 

1 "" 

Pfix) = du{x) + -J2 i\dij{x)\ + \dp{x)\) . 

Define D = {x E R^ : ||a;|| < M} for some M > 0 and assume that dij{x)xi 
are continuous on RL for i,j = 1,... ,n, such that i j■ Then the zero 
solution of m is 
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(a) stable if —oo < Pi{x) < 0 for i = 1,2,... ,n and x G D. 

(b) asymptotically stable if —oo < Pi{x) < 0 for i = 1,2,... ,n and x E D. 

(c) globally asymptotically stable if —oo < Pi{x) < 0 for all x G -R”. 


Proof. Consider 




i=l 


as a tentative Lyapnnov fnnction for system ((T|). We have, along a solntion 
of (P), 


2=1 2=1 


dt 


E 

2=1 


Xi 


dii{x)xi + dij{x)xj 


3 = 1 


< 


E 

2=1 


E 

2=1 


E 

2=1 


E 

2=1 


dii{x)xl + '^dij{x)xjXi 


3 = i 


dii{x)xl + - 'Yydij{x) + dji{x)\xjXi 


3=1 

3#* 


dii{x)xl + jJ2^\dij{x)\ + \dji{x)\]{x^j + xl 


3 = 1 


dii{x) + ^ 1 [Mo(^)l + \dji 


X 


3 = 1 
39^i 


X, 




2=1 


Expanded form of system © i 


IS 


dt 


< 


E 

i=l 


dii{x)xiXi + - '^[\dij{x)xiXi\ + \dji{x)xiXi\] 


3 = 1 


(5) 

( 6 ) 
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By Remark^ the first and third terms of system are continuous on i?"", 
and by assumption of Theorem 0 the second term is also continuous on . 
Hence V{x) is continuous on . Since 

1 

= 2 (7) 

i=l 

we have therefore, R(0) =0 and V(x) > 0 for all x G -R” \ {0}. From 
equation Q, 

n 

V'(x) <'^i3i(x)xi^ ( 8 ) 

i=l 

and by condition (a) of Theorem El we have V'{x) < 0 for all x & D. Hence 
by Theorem Q the zero solution of system m is stable. Moreover, by con¬ 
dition (b) of Theorem El equation (jH)) implies R'(0) = 0 and V'{x) < 0 for 
all a; G R \ {0}. Hence by Theorem El the zero solution of system m is 
asymptotically stable. Furthermore, by condition (c) of Theorem El equa¬ 
tion (IHl) implies R'(0) = 0 and V'{x) < 0 for all x G R”. Note that Q 
implies V{x) —>• cx) as ||a;|| —>• oo, thus V{x) is radially unbounded. Hence 
by Theorem El the zero solution of system m is globally asymptotically 
stable. □ 

Let us consider some examples to show the applicability of Theorem El 

Example 1. We consider the following two-dimensional system 

x[{t) 

_ 3^2 W 

with xi{to) = xio and X 2 (to) = X 20 . In the form of system Q, system 0 
can be written as 


x'i(f) 


1 

1 

to 

H 

to 

_1 


Xi 

1 


Xi —2 


X2 



1 - 

+ 

1 

1 _ 


xl — 2X2 


(9) 


The assumption of Theorem El is satished since 


di2{x)xi = d2l{x)x2 = X1X2 . 
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Next we shall check condition (a) of Theorem El We have 

(3i{x) = dii(a;) + ^ (|di 2 (a;)| + |(i 2 i(a;)|) 
= “2 + - (1x21 + |xi|) . 

Solving the inequality Pi{x) < 0, we have 

|xi| + |X2| < 4 , 

and ‘squaring’ both sides gives 

Xi^ + X2^ + 2|xi||x2| < 16 . 


Now 

Xi^ + X2^ + 2|xi||x 2| < Xi^ + X2^ + 2 X ^ (xi^ + X2^) = 2xi^ + 2X2^ . 

Then let 

2xi^ + 2x2^ < 16 

from which 

Xl^ + X2^ < 8 . 

Similarly solving ^^{x) < 0, we have 

^ 2 (®) = d22{x) + ^ {\d2i{x)\ + \di2{x)\) < 0 , 

which gives 

—2 + - (|xi| + |x 2 |) < 0. (10) 

Further simplihcation of m gives us 

Xi^ + < 8 . 


Therefore, let 

D = {x e ■. ||a;|| < \/8} . 

Hence by condition (a) of Theorem El the zero solution of system is 
asymptotically stable. 
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Example 2. We consider the following two-dimensional system 


x[{t) 


—4xi -|- xisech(xi) -|- 4x2 

. x'2it) _ 


—xi — 6 x 2 — X 2 cos (X 2 ) 


( 11 ) 


which can be written in the form of system © as 

-4 -|- sech(a;i) 4 


1 


. X'2it) _ 



-1 


—6 — COs(x2) 



Xi 


. ^2 . 


The assnmption of TheoremElis satisfied since di 2 {x)xi = Axi and d 2 i{x)x 2 = 
—X 2 - Next we shall check condition (c) of Theorem El We have 

(3i{x) = dii{x) + ^ {\di 2 {x)\ + \d 2 i{x)\) 

1 

= -4sech(xi)-h - (|4|I - 1|) 

, , , 3 3 1 

= sech(xi) - =--<0. 

Similarly, we have 

/32{x) = d 22 {x) + ^ {\d 2 i{x)\ + \di 2 {x)\) 

= -6-cos(x2) + ^(|-1| + |4|) 

7 7 5 

= “2-cos(x2) <--+ 1 =--< 0. 

Since both Pi{x) < 0 and (d 2 {x) < 0 for all x G hence by condition (c) of 
Theorem El the zero solution of system m is globally asymptotically stable. 


3 Application in Artificial Neural Networks 

Artificial neural networks (ANNs) can be considered as dynamical systems 
with several equilibrium states. An essential operating condition for a neu¬ 
ral network is that all system trajectories must converge to the equilibrium 
states. (A good overview of the concepts associated with biological neural 
networks is given in Ej). 












We will consider an ANN that is described thoronghly in Lakshmikan- 
tham et al. (H] , and provide a stability criteria nsing Theorem El The ANN 
in qnestion has n nnits. To the zth nnit, we associate its activation state at 
time t, a real nnmber x* = Xi(t); an output function /i*; a hxed bias di\ and 
an output signal Ri = ^i{xi + 6i). The weight or connection strength on the 
line from nnit j to nnit i is a hxed real nnmber Wij. When Wij = 0, there 
is no transmission from nnit j to nnit i. The incoming signal from nnit j 
to nnit i is Sij = WijRj. In addition, there can be a vector I of any nnm¬ 
ber of external inputs feeding into some or all nnits, so that we may write 

An ANN with hxed weights is a dynamical system; given initial valnes of 
the activation of all nnits, the fntnre activations can be compnted. The fntnre 
activation states are assnmed to be determined by a system of n diherential 
eqnations, the Ah eqnation of which is 

Xj^it') = Gii^Xi, Sii, ■ ■ ■ t Sin, -f) ~ Gi{Xi, Wi\R\^ • • • ) ^^inRn, I') 

WiifXil^Xi -|- ^l), • • • ) ^^inhni,^n T ^n), Ry ■ ■ ■ , ^ni) ■ (12) 

With Wij, 6i and R assnmed known, we can write m as 

x'iit) = gi{xi,...,Xn), ( 13 ) 

or in vector notation 

x'{t) = g{x) , ( 14 ) 

where is a vector on Enclidean space -R"" whose Ah element is g* given in 
m- We assnme that g is continnonsly diherentiable and satishes the nsnal 
theorems on existence, continnity and nniqneness of solntions. Thns, since 
g G C"[R”, RR, we can dehne D{x) as in m bnt nsing g in (HI. Hence, if 
g(0) = 0, then system dn can be written as 

x'{t) = D{x)x , xRq) = Xq , 
the Ah component of which in a deconpled form is 

n 

x'(f) = dii{x)xi ^'^dij{x)xj . 
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First, we state a comparable result by Lakshmikantham et al. [B], page 152, 
who used the concept of vector Lyapunov functions. 

Theorem 6 (Lakshmikantham, Matrosov and Sivasundaram [IB]). 

Let g e C'[R^, R^] and g(0) = 0. Let 

n 

fdi{x) = dii{x) + ^ \dij{x) \ . (15) 

Suppose that 

(3i{x) <0 if xl > , (16) 

for i,j = 1,... ,n and x G R^, x ^ 0. Then the zero solution of in is 
globally asymptotically stable. 

If we apply condition (b) of Theorem 0 then we obtain a simpler conver¬ 
gence criteria. 

Theorem 7. Let g G C'[R^, R^] and g{0) = 0. Let 

1 

= dii{x) -|- — ^ ^ {\dij{x) \ \dji{x)\) . 

Define D = {x ^ i?” : ||a;|| < M} for some M > 0 and assume that 
dij{x)xi are continuous on RL for i,j = l,...,n, such that i ^ j. Then 
the zero solution of a is asymptotically stable if —oo < Pi{x) < 0 for 
i = 1, 2,..., n and x E D. 

Thus, the application of Theorem El to artificial neural network, consider¬ 
ing system (HI, gives us a simpler criterion guaranteeing asymptotic stability 
as showed by Theorem |B1 Hence the strong condition > x'j that appears 
in Theorem |B] is not necessary. 

Next, we look at a specific case of dn. The specihc ANN is of the additive 
type and is often referred to as the Hopfield-Tank ANN, a much studied class 
of network dynamics [7] . It is described by the nonlinear differential equation 

n 

x'i{t) = -aiXi{t) + ^ Wij tij{xj{t) + 0j) + Ii{t) 

i=i 

n 

= -aiXi{t) + ^ Wij jyj{xj{t)) + Ii{t) , (17) 

i=i 
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where a* > 0 is the constant decay rate, Ii{t) is the external inpnt (to the 
ith nenron) dehned almost everywhere on [0, cx)) and Vi is the snppressed 
notation for the fixed 6i by having 9i incorporated into /r*. The fnnction Vi 
is called the neuron activation function. 

Now, define A = diag(—Oi,..., —a„), x = (xi,..., XnY', 

n 

hi{x) = ^ WijUjixj) with h{x) = {hi{x),Kix))'^ , 
and u{t) = {Ii{t ),..., In{t)Y. Then (|T7j) is the ith component of the system 


x'(f) = Ax + h{x) + u{t ), x{to) = Xq . (18) 

When the external inpnt vector, u, is zero, the nonantonomons system m 
rednces to the antonomous system 


x'{t) = Ax + h{x ), x{tQ) = Xq . 


(19) 


For this, we assnme that x* = {xl ,..., is an eqnilibrinm point, so that 
Ax* + h{x*) = 0. By translating the origin, 0, to this eqnilibrinm point, 
we can make 0 an eqnilibrinm point. In this case, h{0) = 0. Since this is of 
great notational help, we will henceforth consider 0 as an eqnilibrinm point 
or zero solntion of (HI. 

Let ns next assnmed that h G C'[R^, R"']. Then nsing the elements of 
Jacobian matrix, Jij{x), we define 


Fix) = [fijix)]^^^ where fijix) 
hence system dH can be rewritten as 



dhiisx) 

disxj) 


ds, 


x'it) = Ax + Fix)x = [A + Fix)] X . (20) 

The ith component of dUl) in a deconpled form is 

n 

x'.{t) = [-Oi + fiiix)]Xiit) + ^ fijix)Xj . 

J=1 

jri 

Thns the following theorem is an application of onr resnlt; Theorem El 
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Theorem 8 . Let h G C'[R^, R^] and h{0) = 0. Let 


1 

I3i{x) = -an + fii{x) + + l/i*(®)l) • 

Define D = {x G BD : ||a;|| < M} for some M > 0 and assume that fij{x)xi 
are continuous on for i,j = 1,... ,n, such that i ^ j. Then the zero 
solution of iiyi) is 

(a) stable if —oo < fifix) < 0 for i = 1,2,... ,n and x G D. 

(b) asymptotically stable if —oo < fifix) < 0 fori = 1,2,... ,n and x E D. 

(c) globally asymptotically stable if —oo < fifix) < 0 for all x G RT. 


Proof. Applying Theorem El to system (|T^ . and hence to system pfH) . with 
D{x) = A + F{x), dii{x) = -Ui + fii{x) and difix) = fifix), we easily 
obtain the conclusion of Theorem El □ 

Let us consider one example of Theorem El 


Example 3. Let us consider two-neural autonomous system. 


x'fit) 

x'fit) 


— Ql 

0 


Xi 

+ 

hfix) 

0 

-02 


X2 


h2{x) 


with xi(to) = X 2 {tfi) = X 20 , 0 < to < t, where. 


( 21 ) 


Oi = 10, 02 = 10 , 

hfix) = Biivfixi) + Bi 2 V 2 {x 2 ) =-^Xi + X 2 - taxhfilxi), 

h2{x) = B2iizfixi) + B22i'2{x2) = Xi - X2 + La.nh.{ 3 x 2 ) ■ 

5 

In the form of system (GOD, system m can be written as 


x'fit) 

( 

-10 

0 

+ 

1 

T—1 

r 

1 

CO 

1 


Xl 

Afi) _ 

i 

0 

-10 

1 -1 +-r(a: 2 (t)) 

j 

X2 
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where for i = 1, 2, we define 

T{Xi{t)) 


tanh(3a;i) 

Xi 

3 


7^ 0) 

Xi = 0, 


noting that 0 < T{xi) < 3 for all Xi E B?. The assnmption of Theorem |H1 
is satisfied since fi 2 {x)xi = Xi and f 2 i{x)x 2 = X 2 . Now we shall check 
condition (c) of Theorem |H1 We have 

Pi{x) = -ai +fn{x)+ ^{\fi2{x)\ + \f2i{x)\) 

= —10 — 3 — r(xi(f)) +-(|1| + |1|) 

= -12-r(xi(f)) (22) 

< -12 


for all X E \ {0} and 

P2{x) = —0.2 + f22ix) + -{\f2l{x)\ + \fi2{x)\) 

= -10 - 1 +-r(a;2(f)) +-(|1| + |1|) 

= -10 + ^r(a;2(t)) (23) 

5 

3 47 

for all X E \ {0}. Clearly, both f3i{x) < 0 and (32{x) < 0 for all x E 

R" \ {0}. 

Next, we shall check the condition on Pi{x) for x = 0, where z = 1,2. 
From ()22|1 . we have 

Pi{x) = -12 - T{xi{t)). 


Therefore, 


/3i(0) 


Similarly, from (1231), we have 


-12 - 3 = -15. 


P2{x) 


-10 + ^r(x2(t)). 
5 
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Therefore, 


3 47 

P2{0) = -10 + - = --. 

Since (3i{x) < 0 and (32{x) < 0 for all x G therefore, by condition (c) of 
Theorem IHl the zero solution of system m is globally asymptotically stable. 

4 Conclusion 

We have established the criteria for stability, asymptotic stability and global 
asymptotic stability for a non linear autonomous system via the method of 
Lyapunov. We have also considered the usefulness of our main results by 
application of it to artihcial neural networks. 

Further research in this direction is being carried out, considering a non 
autonomous system, wherein the external input source is not assumed to be 
zero. Determining the convergence criteria for a non autonomous system 
and to measure its rate of convergence will be of grandness in applications 
to artificial neural networks. 
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